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INTRODUCTION 


The  successful  development  of  an  autonomous  3-D  vision  system  would  be  of 
considerable  value  and  importance  to  future  national  defense  related  systems 
as  well  as  numerous  domestic  applications.  Within  the  U.S.  Army,  applications 
for  such  a  vision  sytera  would  include  autonomous  navigation  of  various  Army 
vehicles  and  weapon  systems,  ammunitions  supply,  autoloading  systems,  and 
target  recognition* 

Numerous  approaches  are  currently  being  investigated  for  3-D  systems. 

One  such  potentially  successful  approach  involves  analysis  of  range  data  as 
might  be  obtained  from  a  laser  rangefinder.  One  of  the  authors  of  this 
report,  C.  N.  Shen,  has  been  conducting  studies  since  1968  at  Rensselaer 
Polytechnic  Institute  on  application  of  an  autonomous  laser  rangefinder  vision 
system  for  a  Mars  rover  vehicle  (see  Reference  1  for  a  summary  of  this  work). 
It  is  assumed  herein  that  a  matrix  of  systematically  measured  ranges  is 
obtained  for  a  given  field  of  view.  This  matrix  can  then  be  treated 
analytically  for  purposes  of  object  location,  navigation,  and  scene  analysis. 

Our  current  study  deals  with  a  small  aspect  of  the  overall  problem.  The 
specific  problem  considered  is  edge  detection  of  objects  on  a  sloped,  possibly 
wavy  plane.  An  example  might  be  the  location  of  boulders,  rocks,  craters, 
sharp  hills,  trees,  etc.  in  the  autonomous  navigation  of  a  vehicle  over 
terrain.  The  procedure  used  for  edge  detection  is  called  RES  (rapid 


1-Shen,  G.  N. ,  "Autonomous  Navigation  for  Mobile  Robot  Vehicles  Over  Hilly 
Terrain  Using  Rangefinder  Measurements,”  Proc-  Robot  Intelligence  and 
Productivity  Conference,  Wayne  State  University,  Detroit,  MI,  November  18-19 
1983. 
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estimation  scheme)  by  Sonalkar,  Sanyal,  Kim,  and  others  (refs  2-4).  RES  is 
basically  a  decision-directed  estimation  approach  in  which  the  range  matrix 
which  contains  both  measurement  and  system  noise  is  processed  one  column  (or 
row)  at  a  time.  One  column,  for  example,  of  the  range  matrix  is  a  series  of 
range  measurements  obtained  at  different  incrementally  varied  elevation  angles 
(P^)  for  fixed  azimuth  angle  (0j),  as  shown  in  Figure  1.  This  vector  is 
analyzed  by  stepping  through  each  range  measurement  element  one  at  a  time  and 
using  a  combination  of  (1)  Bayesian  decision  criteria  to  detect  impulses 
(edges  of  objects),  (2)  impulse  estimation  if  an  edge  is  detected,  and  (3) 
Kalman  filtering  if  no  edge  is  detected.  The  system  model  used  for  the  Kalman 
filter  is  a  plane  with  fixed  or  adaptive  slope. 

The  particular  numerical  procedure  presented  herein  involves  a  single 
term  state  vector  (range)  with  adaptive  procedures  for  handling  objects  on  a 
sloped  plane.  This  results  in  a  procedure  nearly  twice  as  fast  as  approaches 
using  a  two-term  state  vector  (range  and  slope)  as  used  by  Kim  et  al  (ref  4). 

The  main  goals  of  the  work  presented  in  this  report  are  to  (1)  study 
approaches  for  minimizing  false  alarms  given  a  minimum  size  object  to  be 
detected,  and  (2)  determine  specifications  for  accuracy  of  instrumentation, 
such  as  a  laser  rangefinder,  required  to  detect  given  object  sizes. 


Sonalkar,  R.  V.  and  Shen,  C.  N.  ,  "Mars  Obstacle  Detection  by  Rapid  Estimation 
Scheme  from  Noisy  Laser  Rangefinder  Readings,M  Proc*  of  the  Milwaukee 
Symposium  on  Automatic  Computation  and  Control,  Wisconsin,  April  1975,  pp. 
291-296. 

•^Sanyal,  P.  ,  "Rapid  Estimation  of  States  by  Detecting  Unknown  Impulse  Inputs 
at  Unknown  Times,"  PhD  Thesis,  Rensselaer  Polytechnic  Institute,  Troy,  NY, 
University  Microfilms,  Ann  Arbor,  MI,  1973. 

^Kim,  C.  S. ,  Marynowski,  R.  C.,  and  Shen,  C.  N. ,  "Obstacle  Detection  Using 
Stabilized  Rapid  Estimation  Scheme  With  Modified  Decision  Tree,"  Proc.  of 
JACC ,  Philadelphia,  PA,  October  1978. 
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SINGLE  TERM  RAPID  ESTIMATION  SCHEME 


la  this  and  the  next  section  a  summary  of  the  RES  procedure  is  presented. 
For  more  detailed  discussion  of  the  Kalman  filter,  impulse  estimation  and 
Bayes1  risk  analysis,  the  reader  is  referred  to  References  3,  5,  and  6. 

Range  measurements  are  assumed  available  in  the  form  of  a  matrix  Z  in 
which  the  element  represents  the  measured  ranges  for  elevation  angle  0-£ 

and  azimuth  angle  0 j ,  as  shown  in  Figure  1.  In  the  RES  procedure  only  one 
column  (row)  of  this  matrix  is  processed  at  a  time  and  edges  of  objects,  if 
any,  detected.  In  this  report  only  column  processing  will  be  considered  where 
it  is  assumed  that  0j  is  arbitrarily  fixed.  Each  column  is  processed  in  a 
similar  manner,  and  the  outline  of  object  edges  inferred  from  the  results  of 
the  column  processing.  Row  processing  can  also  be  accomplished  for  more 
object  detail. 

For  a  given  column,  processing  begins  with  the  point  at  the  highest 
elevation  (lowest  value  of  0  in  Figure  1).  Each  subsequent  0  point  is  then 
incrementally  considered.  At  a  given  point  a  Bayesian  decision  criterion  is 
used  to  determine  if  a  jump  in  actual  over  expected  range  is  indicated.  If 
not,  Kalman  filtering  Is  used  to  obtain  a  better  state  estimate  at  the  next 
point,  and  so  on.  If  an  impulsive  jump  is  detected,  then  the  measured  range 
at  the  next  point  becomes  the  starting  point  for  continued  processing.  After 


^Sanyal,  P. ,  "Rapid  Estimation  of  States  by  Detecting  Unknown  Impulse  Inputs 
at  Unknown  Times,"  PhD  Thesis,  Rensselaer  Polytechnic  Institute,  Troy,  NY, 
University  Microfilms,  Ann  Arbor,  MI,  1973. 

^Kalman,  R.  E.,  "A  New  Approach  to  Linear  Filtering  and  Prediction  Problems," 
Trans,  of  ASME,  Journal  of  Basic  Engineering,  March  1980,  pp.  35-45. 

^ Sage  and  Me Is a,  Estimation  Theory  With  Applications  to  Communications  and 
Control,  McGraw-Hill,  New  York,  1971,  Chapter  5,  "Decision  Theory." 
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an  edge  detection  the  Kalman  filter  is  reset  to  ignore  previous  data.  The 
entire  column  of  ranges  is  processed  in  this  manner  storing  location  and 
values  of  recorded  jumps. 


Figure  1.  Top  and  side  view  of  a  rangefinder. 

If  x-£  represents  the  true  range,  then  (the  j  subscript  is  dropped  from 
now  on  since  it  remains  fixed  for  a  given  column  processing)  is  given  by: 

zi  “  xi  +  n  (1) 

in  which  Vi  is  added  measurement  noise  assumed  to  be  white  and  Gaussian 
distributed  with  mean  zero  and  variance  R. 

The  equation  of  state  for  this  problem  is  given  by: 

xi+l  =  Fi*i  +  wi  +  6ik  uk  (2) 

in  which 


4 


sin3-£  +  tanr^  cos3f 

p ,  - - for  column  processing;  (3) 

sin3i+i  +  tanni  cos  3i+i 

Hi  38  slope  of  the  plane  (terrain)  near  point  i; 
w^  =  system  noise  such  as  terrain  noise  which  is 
assumed  white  and  Gaussian  distributed  with 
mean  zero  and  variance  Q;  and 
u^  =  impulsive  jump  in  the  range  at  point  k  caused 
by  presence  of  an  object. 

In  Eq.  (2),  xi+i  represents  the  range  for  elevation  angle  3i+l,  and  can 
be  estimated  from  information  prior  to  point  i+1.  In  the  computer  algorithm 
hi  is  determined  adaptively  using  ranges  near  and  prior  to  point  i. 

Standard  Kalman  filtering  is  used  to  obtain  estimates  of  the  ranges  from 

A 

the  measured  data  if  no  impulsive  input  is  detected  where  x^  and  are  the 
estimate  and  error  covariance  at  point  i: 

Prediction: 

(4) 


xi+l  =  Fixi 

Mi+1  =  Fi2Pi  +  Qi 

=  variance  of  the  error  in  x^-n 


(5) 


Kalman  Gain: 

Ki+1  =  Mi+l(Mi+l+Ri+l)~ 

Correction: 

xi+l  “  xi+l  +  Ki+l(zi+l“xi+l)  <7) 

Pi+1  -  (l-Ki+i) 2M1+1  +  Ki+12Ri+1  (8) 

For  the  case  in  which  no  prior  data  is  included  such  as  when  first 
starting  the  column  processing  or  immediately  after  a  jump  is  detected,  then 

A 

x^  and  Pj^  are  estimated  directly  as  and  Rj_. 
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DETECTION  OF  OBJECT  EDGES 


In  stepping  through  each  point  i  of  the  range  vector,  a  decision  must  be 
made  as  to  whether  or  not  an  impulse  (e.g.  object  edge)  is  present  between 
points  i  and  i+1.  This  is  accomplished  by  setting  up  a  number  of  hypotheses 
and  then  applying  a  decision  rule  to  determine  which  hypothesis  is  most 

probable,  given  the  data.  Essentially,  the  measured  ranges  are  statistically 

compared  to  predicted  ranges  assuming  no  impulse.  The  hypotheses  considered 
are  listed  as  follows: 

Hi  -  impulsive  input  exists  between  points  i  and  i+1 

H2  -  impulsive  input  exists  between  points  i+1  and  i+2 

H3  -  impulsive  input  exists  between  points  i+2  and  i+3 

-  no  input  exists  between  points  i  and  i+3 

The  motivation  for  considering  the  states  at  the  three  forward  points  is  to 
improve  reliability  of  the  decision  process  (see  Reference  4  for  discussion  of 
this  approach). 

A  Bayesian  decision  rule  (ref  6)  is  then  applied  to  the  hypotheses  and 
the  hypothesis  with  lowest  Bayes’  risk  determined.  If  is  not  chosen,  then 

the  range  at  i+1  is  estimated  using  Eqs.  (4)  through  (8)  and  the  entire 

decision  process  is  repeated  at  this  next  point. 


^Kim,  C.  S.,  Marynowski,  R.  C.,  and  Shen,  C.  N. ,  "Obstacle  Detection  Using 
Stabilized  Rapid  Estimation  Scheme  With  Modified  Decision  Tree,"  Proc.  of 
JACC,  Philadelphia,  PA,  October  1978. 

^Sage  and  Melsa,  Estimation  Theory  With  Applications  to  Communications  and 
Control,  McGraw-Hill,  New  York,  1971,  Chapter  5,  "Decision  Theory." 
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If  Hx  is  chosen,  the  location  of  the  detected  edge  is  stored  along  with 

A 

other  pertinent  information.  Then  the  range  estimates  xi+1  and  Pi+i  are  set 
equal  to  the  measured  range  zi+i  and  R,  respectively,  and  the  process  is 
reinitiated  and  continued  until  the  entire  vector  of  ranges  is  processed. 

The  conditional  probabilities  of  the  measured  data  given  the  hypotheses 
are  used  to  compute  the  Bayes'  risk  for  the  ftth  hypothesis. 


4 

B*  -  l  PkC*kF(Z|Hk)  5  l  -  1,2, 3, 4 
k=l 


(9) 


in  which  pk  =  prior  probabilities  for  hypothesis  k; 

c^k  =  cost  associated  with  choosing  Hjj,  when 

actually  Hk  is  correct; 

F(Z|Hk)  =  conditional  probability  density  of 

range  measurements  Z  given  Hk  is  true. 

In  Eq.  (9)  the  hypothesis  %  is  chosen  which  minimizes  Bayes'  risk  B £.  The 
densities  F(Z|Hk)  are  given  as  follows: 


F(Z/Hk) 


3  1  1  . 

1 f - exp  {-  -Jkn  } 

n=l  m  |wkn|l/2  2 


(10) 


in  which 

Jkn  =  (zi+n  “  xki+n)(Wki+n)“  Hzi+n-x^+n) 

Wki+n  =  Mki+n  +  Ri+n 

=*  predicted  range  at  point  i+n  based  on 
cumulated  information  at  point  i+n-1  for 
the  kth  hypothesis. 

In  Eq.  (10)  if  an  impulse  is  assumed  to  have  occurred  just  prior  to  point  i+n, 
then  is  set  equal  to  Zi+n*  For  more  details  on  the  derivation  of  Eq. 
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(10),  see  Reference  3. 


SIMULATION  STUDIES  OF  RES 

The  object  detection  procedure  described  in  the  previous  sections  has 
been  extensively  tested  using  simulation  techniques.  In  these  simulation 
studies,  artificial  scenes  are  created  using  computer  routines.  A  range 
matrix  is  generated  which  contains  known  measurement  and  system  noise  using  a 
random  number  generator.  In  these  studies,  the  RES  procedure  worked  quite 
efficiently  in  locating  the  edges  of  various  kinds  of  objects  setting  on  or 
within  a  given  sloped  plane.  The  main  problems  encountered  were  difficulties 
in  (1)  minimizing  false  alarms  where  a  false  alarm  occurs  when  a  detection  is 
made  at  a  point  where  no  object  input  exists;  (2)  fixing  the  Bayes1  prior 
probabilities  and  cost  factors  in  Eq.  (9);  and,  (3)  determining  effect  of 
parameters  on  minimum  detectable  object  size.  These  problems  are  interrelated 
and  were  studied  using  Monte  Carlo  simulation  in  which  the  main  goal  was  to 
characterize  the  minimum  object  size  that  can  be  detected  as  a  function  of 
model  parameters. 

False  Alarm  Ra_te 

Kim  et  al  (ref  4)  in  their  studies  of  the  RES  procedure,  which  used  a 
two-term  state  vector  (range  and  slope),  fixed  the  Bayes1  parameters.  They 
then  minimized  false  alarms  by  adding  artificial  system  noise  covariance  to 

^Sanyal,  P. ,  "Rapid  Estimation  of  States  by  Detecting  Unknown  Impulse  Inputs 
at  Unknown  Times,"  PhD  Thesis,  Rensselaer  Polytechnic  Institute,  Troy,  NY, 
University  Microfilms,  Ann  Arbor,  MI,  1973. 

^Kim,  C.  S.,  Marynowski,  R.  C.,  and  Shen,  C.  N. ,  "Obstacle  Detection  Using 
Stabilized  Rapid  Estimation  Scheme  With  Modified  Decision  Tree,”  Proc.  of 
JACC ,  Philadelphia,  PA,  October  1978. 


8 


their  model.  This  is  a  common  ad  hoc  procedure  for  handling  unmodeled  inputs 


(ref  7). 

For  our  study,  a  series  of  Monte  Carlo  runs  was  conducted  using  the  RES 
procedure  described  by  Eqs.  (1)  through  (10)  assuming  a  flat  plane  containing 
no  objects.  In  this  case  any  detection  experienced  would  be  a  false  alarm. 

The  parameters  that  were  varied  included  the  addition  of  artificial  noise 
covariance  to  both  the  system  and  measurement  noises  R  and  Q  and  the  Bayes1 
parameters . 

A  number  of  assumptions  were  made  to  reduce  the  20  Bayes’  parameters  in 
Eq.  (9)  to  a  single  parameter.  The  only  hypothesis  that  has  any  consequence 
at  a  given  point  i  is  H^.  If  is  accepted  as  true,  then  a  detection  is 
concluded  and  recorded  with  the  filtering-decision  procedure  being  reinitiated 
at  the  next  point.  If  H2,  H3,  or  H4  is  accepted  as  true,  nothing  is  done 
other  than  continue  the  filtering  procedure  to  the  next  point.  It  will  be 
assumed  then  that  the  prior  probabilities  and  costs  for  H2,  H3,  and  H4  are 
equal  but  different  from  H]_: 

p  =  p2  =  P3  =  P4  *  pi  (11) 

The  cost  parameters  c^  associated  with  choosing  when  actually  is 
correct  are  assumed  to  be: 

c^k  =  0  for  £  =*  k 
=  ci  for  k  =  1  and  £  =  2,  3,  and  4 
=  c  for  £  *  k,  k  =  2,  3,  and  4,  £  =  1,  2,  3,  and  4  (12) 


^ Jazwinski ,  A.  H. ,  Stochastic  Processes  and  Filtering  Theory,  Academic  Press, 
New  York,  1970,  Chapter  8. 
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The  values  of  p,  p^,  c,  and  affect  the  RES  procedure  only  as  a  ratio  given 
by: 


b 


pc_ 

Plcl 


(13) 


In  the  flat  plane  case  with  no  objects  present,  the  range  matrix  was 
generated  assuming  only  measurement  noise  of  mean  zero  and  covariance  R. 
Artificial  noise  can  be  added  to  the  RES  procedure  in  multiples  of  this  R. 

That  is,  R(RES)  =  R  +  f^*R  and  Q(RES)  =  fg*R,  where  the  actual  Q  is  assumed 
zero  in  these  particular  trials. 

Some  of  the  results  of  the  Monte  Carlo  runs  are  given  in  Table  I.  As  can 
be  seen  from  Table  I,  there  are  various  combinations  of  f^,  fg,  and  b  that 
will  yield  a  minimal  number  of  false  alarms  for  the  cases  considered.  The 
next  question  is  which  combination  is  optimum  with  respect  to  the  minimum  size 
detectable  object. 

TABLE  I.  FALSE  ALARM  RATE  AS  A  FUNCTION  OF  RES  PARAMETERS 
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Minimum  Detectable  Object  Size 

In  order  to  study  the  minimum  size  impulse  that  can  be  detected,  a  number 
of  additional  Monte  Carlo  runs  were  conducted  assuming  the  field  of  view  to  be 
a  plane  containing  a  series  of  steps,  both  up  and  down,  with  varying  heights 
from  run  to  run.  The  important  statistic  in  these  runs  is  the  residual  from 
point  i  to  i+1.  The  residual  is  defined  as 

ri+l  ■  zi+l  "  xi+l  <14) 

where  r-^+i  represents  the  difference  in  the  measured  data  (z^+i)  and  the 
predicted  range  obtained  from  filtered  data  up  to  point  i •  If  no  impulsive 
input  exists  at  i+1,  then  r^+i  should  contain  only  measurement  noise  and  would 
be  relatively  small.  In  the  Monte  Carlo  trials,  an  estimate  was  made  of  the 
residual  above  which  the  RES  procedure  resulted  in  a  detection  on  the  average. 
The  distribution  of  detections  about  this  average  appeared  quite  sharp  from 
the  results  obtained  in  this  study.  In  most  cases,  once  the  residuals  passed 
the  calculated  average,  a  detection  was  always  obtained.  Also,  the  calculated 
average  residual  was  found  to  be  independent  of  the  actual  range,  but 
dependent  on  measurement  noise  covariance  R,  artificial  noise  factors  f^  and 
fq,  and  the  Bayes1  parameter  b. 

Table  II  lists  the  results  obtained  for  the  residual  threshold  estimates 
given  as  multiples  of  oR  =»  /r.  The  results  were  obtained  for  different 
combinations  of  f^,  fq,  and  b  which  yielded  zero  or  low  false  alarm  rates  as 
given  in  Table  I. 

From  the  results  presented  in  Table  II,  the  most  efficient  approach  to 
minimizing  detectable  object  size  in  terms  of  minimizing  false  alarms  is  to 
adjust  the  Bayesian  decision  criteria.  The  least  efficient  approach  is  to 
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artificially  add  system  noise  covariance.  Also,  further  decrease  in  the 
residual  threshold  can  be  obtained  if  a  few  false  alarms  can  be  tolerated. 
TABLE  II.  MINIMUM  DETECTABLE  THRESHOLD  LEVELS  FOR  RESIDUALS 
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^Multiples  of  measurement  noise  std.  dev.  Or 

Instrument  Accuracy  Requirements 

The  results  obtained  in 

the  previous  sections  can  be  used  to  estimate  the 

accuracy  of  instrumentation, 

such  as 

a  laser  rangefinder,  required 

to  detect 

objects  of  a  given  size 

at  a 

given  range.  The  required  maximum  instrument 

noise  is  i 

a  function  of 

the  residual  threshold  estimate  r^  as 

given  in 

T 


Residual 

Threshold 


Table  II,  the  height  H  of  the  instrument  above  the  ground,  the  range  p,  and 
the  minimum  object  height  yt  to  be  detected  (see  Figure  2): 

yt((H-yt)2  +  p2)l/2 

rt(H-yt) 


°Rmax 


(15) 
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Equation  (15)  is  derived  by  considering  only  geometric  relationships  of  the 
various  quantities  involved  as  shown  in  Figure  2.  As  an  example,  let  H  =  2 
meters,  p  =  20  meters,  and  yt  =  0.05  meters*  From  Table  II,  choose  rt  to  be 
3.4  (f r  =  fq  =  0.0,  b  =  100).  This  gives  a  required  cjRmax  =  0.15  meters. 


T 


H 


1 


Figure  2.  Geometrical  relationship  of  residual  r  to  model  parameters. 

CONCLUSIONS 

The  RES  procedure  presented  as  Eqs.  (1)  through  (10)  provides  a  fast  and 
efficient  computer  technique  for  object  detection  based  on  range  data  measure¬ 
ments.  The  results  presented  show  minimum  object  size  that  can  be  detected  as 
a  function  of  false  alarm  rate,  Bayesian  decision  criteria,  measurement  noise 
level,  and  covariances  of  artificial  noise  levels.  Results  indicate  that  the 
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most  efficient  approach  to  minimizing  false  alarms  in  terms  of  minimizing 
detectable  object  size  is  to  adjust  the  Bayesian  decision  criteria.  The  least 
efficient  approach  is  to  artificially  add  system  noise  covariance. 

Much  work  remains  to  be  done  on  assessing  available  laser  rangefinders  to 
determine  if  achievable  accuracies  against  non-standard  targets  with  varying 
reflectivity  fall  within  required  accuracies.  The  required  accuracies  can  be 
roughly  estimated  from  the  results  presented  in  this  report  given  the  required 
range  and  minimum  object  sizes  to  be  detected. 
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